What does a matrix look like? 


Matrices are everywhere. If you have used a spreadsheet such as Excel or written numbers in a 
table, you have used a matrix. Matrices make presentation of numbers clearer and make 
calculations easier to program. Look at the matrix below about the sale of tires in a Blowoutr'us 
store — given by quarter and make of tires. 


QI Q2 Q3 04 


Tirestone 25 20 3 2 
Michigan 5 10 15 25 
Copper 6 16 7 21 


If one wants to know how many Copper tires were sold in Quarter 4, we go along the row Copper 
and column Q4 and find that it is 27. 


So what is a matrix? 


A matrix is a rectangular array of elements. The elements can be symbolic expressions or/and 
numbers. Matrix [A] is denoted by 
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Row iof [A] has n elements and is 
(а, Сах д 


апа column j of [A] has m elements and is 


aj 


Each matrix has rows and columns and this defines the size of the matrix. If a matrix [A] has m 
rows and n columns, the size of the matrix is denoted by mxn. The matrix [A] may also be 


denoted by [А],,, to show that [A] is a matrix with m rows and n columns. 


mxn 


Each entry in the matrix is called the entry or element of the matrix and is denoted by а, where i 


is the row number and is the column number of the element. 


The matrix for the tire sales example could be denoted by the matrix [A] as 


45 20 3. 2 
[A]2| 5 10 15 25|. 
6 16 7 27 


There are 3 rows and 4 columns, so the size of the matrix is 3x4. In the above [A] matrix, 
а, = 27. 


What are the special types of matrices? 

Vector: A vector is a matrix that has only one row or one column. There are two types of vectors 
— row vectors and column vectors. 

Row Vector: 


If a matrix [B] has one row, it is called a row vector [В] = [5, b, ...... b,] and n is the dimension 
of the row vector. 


Example 1 


Give an example of a row vector. 
Solution 


[B]2 [25 203 2 0] 
is an example of a row vector of dimension 5. 


Column vector: 
If a matrix [C] has one column, it is called a column vector 
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and m is the dimension of the vector. 


Example 2 
Give an example of a column vector. 
Solution 
25 
ІСІ-| 5 


6 


is an example of a column vector of dimension 3. 


Submatrix: 


If some row(s) or/and column(s) of a matrix [A] are deleted (no rows or columns may be deleted), 
the remaining matrix is called a submatrix of [A]. 


Example 3 
Find some of the submatrices of the matrix 
[A] 4 6 2 
ER: -1 2 


Solution 


К Ё 4 Р Е P 94 


are some of the submatrices of [A]. Can you find other submatrices of [A]? 


Square matrix: 


If the number of rows m of a matrix is equal to the number of columns n of a matrix [A], that is, 


т=п, then [A] is called a square matrix. The entries a,,,d,,,...,a,, are called the diagonal 


elements of a square matrix. Sometimes the diagonal of the matrix is also called the principal or 
main of the matrix. 


Example 4 
Give an example of a square matrix. 
Solution 
45 20 3 
[А]=| 5 10 15 
6 15 7 


is a square matrix as it has the same number of rows and columns, that is, 3. The diagonal elements 
of [A] аге a, 225, a4, 210, а, =7. 


Upper triangular matrix: 


А nxn matrix for which a, — 0, i> j for all i, j is called an upper triangular matrix. That is, all 
the elements below the diagonal entries are zero. 


Example 5 


Give an example of an upper triangular matrix. 
Solution 


10 -7 0 
(41-10 -0.001 6 
0 0 15005 


is an upper triangular matrix. 


Lower triangular matrix: 


А nxn matrix for which а, =0, j >i for all i, j is called a lower triangular matrix. That is, ай 
the elements above the diagonal entries are zero. 


Example 6 
Give an example of a lower triangular matrix. 
Solution 
1 0 0 
(41-103 1 0 
06 25 1l 


is a lower triangular matrix. 


Diagonal matrix: 


A square matrix with all non-diagonal elements equal to zero is called a diagonal matrix, that is, 
only the diagonal entries of the square matrix сап be non-zero, (a, —0, iz j). 


Example 7 
Give examples of a diagonal matrix. 
Solution 
3 0 0 
[A]=|0 2.1 0 
0.0 5 


is a diagonal matrix. 
Any or all the diagonal entries of a diagonal matrix can be zero. For example 


3 0 0 
[А]= [0 2.1 0 
ооо 


is also a diagonal matrix. 


Identity matrix: 


A diagonal matrix with all diagonal elements equal to 1 is called an identity matrix, (a, 20, i + j 


for all i, j and а, =1 for all i). 


Example 8 


Give an example of an identity matrix. 
Solution 


[A]= 


оо н c 
or о о 
— о о оь 


1 
0 
0 
0 
is an identity matrix. 


Zero matrix: 


A matrix whose all entries are zero is called a zero matrix, (a; = 0 for all i and j ). 


Example 9 
Give examples of a zero matrix. 
Solution 
0.00 
[A]J=|0 0 0 
000 
000 
цал p 0 J 
0000 
[C]=|0 0 0 0 
0 0 0 0 
[D]-[|o 0 0] 


are all examples of a zero matrix. 


Tridiagonal matrices: 


A tridiagonal matrix is a square matrix in which all elements not on the following are zero - the 
major diagonal, the diagonal above the major diagonal, and the diagonal below the major diagonal. 


Example 10 


Give an example of a tridiagonal matrix. 
Solution 
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0 0 
is a tridiagonal matrix. 


Do non-square matrices have diagonal entries? 


Yes, fora mx n matrix [A] , the diagonal entries are a,,,45,..., a, ,, ,,a,, Where k = min{m,n}. 


Example 11 
What are the diagonal entries of 
32 2 
6 
2.9 3.2 
5.6 7.8 


[A] = 


Solution 


The diagonal elements of [A] are a,, =3.2 and a,, =7. 


Diagonally Dominant Matrix: 


A nxn square matrix [A] is a diagonally dominant matrix if 


n 


7-1 


п 
а |> У |a; | for at least one i, 


j=l 
ij 


that is, for each row, the absolute value of the diagonal element is greater than or equal to the sum 
of the absolute values of the rest of the elements of that row, and that the inequality is strictly 


greater than for at least опе row. Diagonally dominant matrices are important in ensuring 
convergence in iterative schemes of solving simultaneous linear equations. 


Example 12 


Give examples of diagonally dominant matrices and not diagonally dominant matrices. 
Solution 


15 6 7 
[A]=|2 -4 -2 
3 2 6 


is a diagonally dominant matrix as 
la,,| 2 [15 2152 |a,,|+|a,,| =|6] [7| 213 
а = [- 4| 74 2 Jas] *|as| -21-1-2-4 
as|7 |6| = 62 |as,| jas | 8| + 2| 75 


and for at least one row, that is Rows 1 and 3 in this case, the inequality is a strictly greater than 
inequality. 


-15 6 9 
[B]-| 2 -4 2 
3 -2 5.001 


is a diagonally dominant matrix as 


Ibi| =|- 15] 2152 |b,.| +|b,3| =|6+ 9| =15 
Ib] =| 4| = 4 = | Га = [2] +|2| = 4 
(Ж = 5.001 = 5.0012 р. | +, | = 8 +|- 2 -5 


The inequalities are satisfied for all rows and it is satisfied strictly greater than for at least one row 
(in this case it is Row 3). 


28: de d 
|С|-| 64 8 1 
144 12 1 


is not diagonally dominant as 
lcs] = [8| = 8 € |e,,| - less] = 164+ = 65 


When are two matrices considered to be equal? 


Two matrices [A] and [B] are equal if the size of [A] and [B] is the same (number of rows and 
columns of [A] are same as that of [B]) and a, = Р, for ай i and j. 


Example 13 
What would make 


КЕРЕ 
(06 7 


to be equal to 


Solution 


The two matrices [A] and [B] ould be equal if 5, 22 and b,, 2 7. 
ITERATIVE METHODS FOR SOLVING LINEAR SYSTEMS OF 
EQATIONS: 


Iterative Solution Methods 


* Starts with an initial approximation for the solution vector (x?) 

* At each iteration updates the x vector by using the sytem Ax-b 

* During the iterations A, matrix is not changed so sparcity is preserved 
* Each iteration involves a matrix-vector product 


* If A is sparse this productis efficiently done 


Iterative solution procedure 


* Write the system Ax-b in an equivalent form 
x=Ex+f (like x=g(x) for fixed-point iteration) 


* Starting with x?, generate a sequence of approximations {x*} 
iteratively by 


хе Ех 
* Representation of E and f depends on the type of the method used 


* But for every method E and f are obtained from A and b, but in a 
different way 


Convergence 


* As Куо, the sequence {x*} converges to the solution vector under 
some conditions on E matrix 


* This imposes different conditions on A matrix for different methods 


* For the same A matrix, one method may converge while the other 
may diverge 


* Therefore for each method the relation between A and E should be 
found to decide on the convergence 


Iterative Methods: For Example 
1) Jacobi Method 
2) Gauss Seidel Method 


Jacobi Method 
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x*tl=Exk+f iteration for Jacobi method 


A can be written as A=L+D+U (not decomposition) 
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ALGORITHM OF JACOBI METHOD: 


Jacobi Iterative 


To solve Ax = b given an initial approximation x: 

INPUT the number of equations and unknowns n; the entries а;;, 1 = i, j = n of the 
matrix A; the entries bj, 1 = i = nof b; the entries ХО;, 1 = i x nof XO = x: tolerance 
TOL; maximum number of iterations N. 


OUTPUT the approximate solution хү,..., x, or a message that the number of iteration: 
was exceeded. 


Step 1 Setk = 1. 
Step 2 While (k = М) do Steps 3-6. 
Step 3 Fori = l,...,n 


n 
- M'(aijXO;) + bi 
га 
set x; — = 3 
dii 
Step á If ||x — ХО) < TOL then OUTPUT (xi,..., x4); 
(Procedure completed successfully.) 


STOP. 
Step 5 Setk = К+ I. 
Step 6 Fori = 1,...,nset XO; = xi. 


Step 7 OUTPUT (‘Maximum number of iterations exceeded’); 
(Procedure completed unsuccessfully.) 
STOP. 


Gauss-Seidel Method 


Use the | t afi} ах, tta, X, =b, х, 
se the latest a, «a. «жа, х. =b 0 
264) se а = 92 х n 


update : 
er ах] -b, х 


1 1 0 0 1-1 n 
xj 2—(bh-ajx;-:--ax,) "TED. ket k 
a ан Үлт b, -234*5 Е У ах, 
J= J= 


11 
1 1 1 0 o ди 
х. = —(b -ayi - asi 777 Ay, X,) 
аж 
1. 1 b 1 1 1 
х, = ( n n1 70,13, = “.-4..аХ,а) 
а,, 


x'ktH=Exlkl4+f iteration for Gauss-Seidel 


Ax=b = (L+D+U)x=b 
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ALGORITHM OF GAUSS SEIDEL METHOD : 


Gauss-Seidel Iterative 


To solve Ax = b given an initial approximation x: 


INPUT the number of equations and unknowns n; the entries.a;jj, 1 = i, j = n of the 
matrix А; the entries b;, 1 < i = n of b; the entries ХО;, 1 = i = nof XO = x; tolerance 
TOL; maximum number of iterations N. 


OUTPUT the approximate solution x;,..., x, or a message that the number of iterations 
was exceeded. 


Step 1 Setk = 1. 
Step 2 While (k = №) do Steps 3-6. 
Step 3 Fori = L...,n 


i-l n 
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х set xj — 
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Step 4 If ||x — XO|| < TOL then OUTPUT (x,,..., Xn); 
(Procedure completed successfully.) 
STOP. 


Step 5 Setk = К+ 1. 
Step б Fori = 1,...,n set XO; = х;. 


Step 7 OUTPUT (‘Maximum number of iterations exceeded’); 
(Procedure completed unsuccessfully.) 
STOP. 


Comparison 


* Gauss-Seidel iteration converges more rapidly than the Jacobi 
iteration since it uses the latest updates 


* But there are some cases that Jacobi iteration does converge but 
Gauss-Seidel does not 


